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Description 

[The largest toy gallery park with 3D 
simulation displays for animations and 

other collectibles juxtaposed with 
physical-virtual collaborative games and 
activities in a three-dimension 
photo-realistic virtual-reality 
environment] 

Background of Invention 

[0001] Almost all amusement parks have traditional dark and 
thrill rides including some water rides. These rides are 
surrounded with carnival type spot entertainment includ- 
ing meeting and playing with popular animated charac- 
ters. Most of these rides are passive in nature visitors sit 
in a vehicle or floatation device and experience the thrill 
or environment of the ride and location of the park. 

[0002] Most amusement parks have traditional building struc- 



tures with audio, video and light to create a thematic en- 
vironment for visitors to experience the location or the 
ride. Most of them are based on physical movement of the 
item, vehicle or device. Most of these structures - the 
building, the interior design, the audio and video, the 
theme - are relatively less dynamic (not changed too of- 
ten) in nature. 

[0003] The present invention is generally relates to a toy gallery 
and theme park which is a Juxtaposition of toys and ani- 
mation characters with experiential, participatory and in- 
teractive games in a digital animation and 3D simulation 
environment. 

[0004] The park has nine galleries with both thematically created 
environment with traditional display materials as well as 
three-dimensional virtual reality display (one of the meth- 
ods could be a three-dimensional virtual reality space dis- 
play processing method, U.S. Patent 6,437,777) of various 
toys, animation characters and other collectibles. These 
three-dimensional rendering virtual-reality displays for 
interactive, i.e., voice activated chat-enabled devices that 
communicate with the visitors in terms of providing infor- 
mation through a medium or requesting pre-determined 
data input and status message indicating a communica- 



tion state. 

[0005] In the toy gallery park, each gallery also has five game 

complexes (much like Cineplex) for interactive, participa- 
tory games in a 3D simulation environment, each game 
complex is catering to each age cohort. Each game- 
complex has 3D photO-realistic simulation environment 
has apparatuses that are synchronized with audio-means, 
visual means and physical means which allows partici- 
pants to interact with the apparatus (could be a human 
shaped mannequin or any other physical or virtual object) 
for visual and audio outputs in a manner corresponding to 
participant movements and engagements with the physi- 
cal apparatus movements and position sensing means and 
responding to a part of the body of the participant and 
adapted to provide a control input to the computer based 
system. 

[0006] in such artificial and highly dynamic environments all pa- 
rameter setting are fully controllable. Thus a simulation 
framework is based on a service-oriented concept is pro- 
posed in order to facilitate the integration of physical vir- 
tual collaborative environment modules, e.g., particular 
sensors, environmental artifacts and even additional plat- 
form for robots (avatar). This ensures that existing photo- 



realistic 3D rendering or robotic applications are used 

various apparatuses in the same way. 
Summary of Invention 



[0007] In one embodiment, the present invention is the gallery 

theme park which is a juxtaposition of various toy and an- 
imation characters from different toy and animation cre- 
ators with participatory, experiential and interactive 
games in digital animation and three-dimensional simula- 
tion environment. The park has nine galleries, each gallery 
has museum, multiple game complexes and retail store. 
The museum provides a mechanism to display various 
toys, action figures and other collectible items that are 
applicable to a gallery in an amusement park providing an 
unique experience and attention-based interaction in a 
virtual-reality environment . In carrying out such invention 
we have provided three-dimension photo-realistic display 
environment in claim 1 which will provide information 
about the physical display items or collectibles and inter- 
act with the participant for questions and answers. This 
will also allow participant to interact with a subject (called 
"Kalpona" - a Indian Hindu mythological rendition of 
imagination) based on his or her movements. 

[0008] Another embodiment of the internal representation is 



based on the concept of providing a new combination of 
features offering a substantial advance in tlie potential to 
heighten human senses in three-dimension photo-real- 
istic virtual environment of an amusement park to achieve 
interactive, participatory experiential games and activities. 
In one aspect the present invention consists in an appara- 
tus for providing a virtual reality games and activity expe- 
rience, the apparatus including audio output, video output 
and physical sensors. The apparatus further comprising a 
control system to synchronize audio, visual and physical 
of the participant to relate to one another. The apparatus 
further connected to computer based systems to process 
participant's physical and audio outputs and its interac- 
tion with the physical object to provide a three-dimension 
photo-realistic virtual-realty scenario update which is se- 
lected from a database and advances in a manner corre- 
sponding to user movements and engagements with the 
physical movement. 
[0009] Let me set up a picture. As a participant enters in the 
gallery a frog (a three-dimension photo-realistic virtual 
reality image) appears on a display screen comes and 
says, "Hey, you with the red color shirt, what is your 
name" and as the participant walks through the gallery. 



the frog walks with him and starts mal<ing conversation. 
"What is your special interest in animation?" the frog asks 
to the participant. As the participant answers that the sce- 
narios and surrounding changes. "Cartoons" the partici- 
pant answers. Based on participants response and move- 
ments the three-dimension photo-realistic virtual reality 
images change. "Here is the paper and pencil, why don't 
you make a cartoon?" the frog hands down the paper and 
pencil (the physical object). Based on the participants 
hand movements, the frog narrates the various styles of 
animation creation and displays toys or animation figures. 
All these are sequentially simultaneously for many partici- 
pants. 

[0010] The present invention overcomes three primary problems 
in the prior work. In the present invention three-di- 
mension photo-realistic virtual reality is created from im- 
ages taken by the cameras because of which the virtual 
world has the fine detail which is photo-realistic. Second, 
because the information is stored and processed from 
both physical and virtual objects - both in audio and 
video, it enhances the experience of the interaction be- 
tween physical-virtual collaboration as it generates virtu- 
alized images from any angle or viewing position. This 



also frees the participant to explore from any vantage 
point and not just prerecorded vantage point. Third, the 
processing of information and scrolling with the virtual 
subject (Kalpona) is so fast and personalized that it cre- 
ates different three-dimension photo-realistic virtual re- 
ality images ( the fine detail captured by the cameras to 
be viewed in a way that CAD modeled environments are 
viewed) and thereby experience to different participants at 

the same time. 
Brief Description of Drawings 

[001 1] For the present invention to be clearly understood and 
readily practiced, the present invention will be described 
in conjunction with the following figures wherein: 

•Figure 1: The physical look of the park with the phys- 
ical structure and the way it is constructed as half- 
underground with the "cooling leaves" on top of it 
•Figure 2: The gallery design and framework 
•Figure 3: The watchdog game framework 
•Figure 4: The reflective car racing track 
•Figure 5: The Animation Story-land 
•Figure 6: Emonic Games design 
• Figure 7: Space Invader design 



•Figure 8: is a blocl< diagram how the physical struc- 
ture and how images are recorded by a plurality of 
cameras 

• Figure 9: is the data flow diagram illustrating signal 
processing 

•Figure 10: is the physical object embodiment 

•Figure 11: is the pictorial illustration of a user envi- 
ronment reflected in a graphical environment accord- 
ing to the method and system of the present invention 

•Figure 12: is the pictorial illustration of a user envi- 
ronment from a perspective of 'kalpona' according to 
the method and system of the present invention 
Detailed Description 

[0012] The present invention is the largest toy gallery theme park 
which is a juxtaposition of various toys, animations, ac- 
tion figures and other collectible characters from different 
toy and animation creating companies with participatory, 
experiential interactive games. 

[0013] The gallery park has nine galleries, each gallery has mu- 
seum, five game complexes and retail store. Each of the 
five game complexes, catering to different age cohort , 
has different themes. The game complex will use the mu- 



seum "theme" and toys to create an environment for the 
participatory game. For example: G.I.Joe characters in the 
museum and the same characters with all the G.I.Joe ac- 
cessories creating an environment for a game - say laser 
tag. These environments will created in 3D simulation, as 
rendition of physical-virtual interactivity 

[0014] jhe present invention is also directed to a new visual ren- 
dition of the museum items which we referred to as three- 
dimension photo-realistic simulation. The physical objects 
(toys, action figures and other collectibles) that are dis- 
played in the gallery are: toys, action figures, dolls, minia- 
ture automobiles, miniature trains, coins, photographs, 
paintings, moving pictures, moving toys, and other col- 
lectibles (hereinafter known as "physical displays"). To be 
more specific, for example, miniature cars are displayed in 
on a 'black' platform (hereinafter considered as "physical 
object") which gives a look of a 'highway.' 

[0015] Jhe host A stores three-dimensional image data for pro- 
viding three-dimension photo-realistic virtual reality dis- 
plays (hereinafter referred as PRVR displays) such as 
streets of New York, London or other locations. These 
PRVR data has been collected for numerous situations - 
such as London road during winter, traffic jam, accident. 



earthquake, etc. and, therefore, do not change. When the 
basic data are not subject to update. This system provides 
the PRVR images of buildings, roads and other items to 
create an environment. The host A also stores data related 
to physical displays to trigger as audio input. 

[0016] The host B controls update objects that constitute both 
audio output and a PRVR space. The update objects are 
avatars for example representing the visitors' response. 
Thus, the host B allows a plurality of visitors (or users) to 
share the same virtual space. It should be noted that the 
host B controls only the update objects located in the dis- 
play area (for example the virtual-reality display of New 
York) controlled by host A. 

[0017] The virtual-service provider (hereinafter called "Kalpona") 
is like a client terminal which receive voice-activated data 
(from the visitors) and the sensor data (the physical 
movement based on camera movement of the visitor) and 
synchronize them to provide the input to the host B. 

[0018] What follows, a procedure of communication between the 
visitor (or user)and 'Kalpona' are recorded and updated in 
the host B which triggers host A to display and/or gener- 
ate audio output based on the information request from 
host B. A predetermined display attribute can be attached 



to overlay message, if the attached display attribute is for 
specifying scrolling or moving (synchronized with visitor 
movement) the overlay message is displayed in a scrolled 
manner (giving an impression of movement). If the display 
attribute is for specifying reverse display, flashing , color- 
ing, or display sizing, the overlay message is displayed as 
specified. 

[0019] In addition to the above mentioned messages, there are 
such messages as a title and words of music to be played 
in a virtual reality space. 

[0020] Jo generate data for the three-dimension photo-realistic 
virtual reality medium, images are recorded using cameras 
positioned to cover the events from all sides. As used 
herein, images could be discreet objects, environments, 
objects interacting with an environment. Each camera 
produces a series of images with each image being com- 
prised of a plurality of pixels. The depth information is 
further manipulated to produce object-centered descrip- 
tions of everything within an image. We develop the 
stand-alone system to synchronously record frames from 
multiple cameras. The output of each camera is time 
stamped with a common Vertical Interval Time Code 
(VITC). The time code allow us to correlate the frames 



across cameras which is crucial when transcribing move- 
ments and triggering effect through host A. 

[0021] Another embodiment may be implemented with the appa- 
ratus including a mannequin, or doll or a part thereof fit- 
ted with appropriate sensors which is connected to the 
control system to advance the audio and visual outputs 
corresponding to user movement or manipulation of the 
mannequin or doll. So, now imaging a little girl (user) 
dancing with 'Barbie' doll. 

[0022] In a preferred embodiment control of the system is 

through the data glove or equivalent device. This is used 
by user physical movements to e.g., select from menus in 
the computer system. 

[0023] All major motions must be monitored and processed by 
the PC in real-time. One known motion tracking system is 
called Motion Star wireless from Ascension Technologies. 
It is a wireless solution that can read up to 20 sensors in 
real-time. This kind of tracking is known as 6D0F (Six 
Degrees of Freedom) tracker. This allows the major move- 
ments of the human to be monitored by the system and 
the information to be processed and applied to the users 
"kalpona." 

[0024] The mannequin or doll is intended to be life-size form 



and have legs, arms, head and body. Outer structure 
would be of a flexible plastic material and closely mimic 
the touch of a human body. The mannequin or doll will be 
responsible for providing any information (i.e., where it 
has been touched or what has been spoken to). This in- 
formation is transmitted to PC via an interface card and 
the software. 

[0025] As the interaction with the mannequin or doll changes, 
the information recorded in PC triggers host A to change 
the environment or updates with new three-dimension 
photo-realistic virtual reality environment. 

[0026] Yet another solution is to allow users or visitors to walk 
on a "walking belt" and the sensors are attached to the 
persons legs and feet can be monitored for walking or 
running movement and thus can be moved accordingly 
within the virtual environment. 



